(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
Iniemaiional Bureau 

(43) International Publication Date 
21 March 20()2 (21.03.2002) 




PCT 



liniiiiiiiiiiiiiiiH 

(10) International Publication Number 

wo 02/22015 A2 



tSl) International Patent Classification^: A6I B 5/055 

(21) International Application Number: PCTAJSO 1/29073 

(22) international Filing Date: 

1 8 September 2001 (1 8.09.2001) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

09/663,989 18 September 2000 (18.09.2000) US 

(63) Related by continuation (CON) or continuation-in-part 
(CIP) to earlier application: 

US 09/663,989 (CIP) 

Filed on 1 8 September 2000 (1 8.09.2000) 

(71) Applicant (for all designated States except VS): JOHN 
HOPKINS UNIVERSITY SCHOOL OF MEDICINE 
[DS/IJS]; 111 Market Place, Suite 906, Baltimore, MD 
21202 (US). 

(72) Inventors; and 

(75) Inventors/Applicants tfor US oniy): SUSIL, Robert, 
Charles [USAJS]; 116 W University Pkwy, Apt. 1417, 
BaJiimore, MD 21210 (US). TAYLOR,' Russell, H. 



(US/USJ; 2 Rivcrvicw Koad Scvcma Park, MD 21218 
(US). 

(74) Agents: CORLESS, Peter, F. et al; Edwards & AngelK 
LLP, P.O. Box 9169. Boston, MA 02209 (US). 

(81) Designated States (national): AE, AG, AL. AM, AT. AU, 
AZ, BA, BB, BG, BR, BY BZ, CA, 01 L CN, CO, CR, CU 
CZ, DE, DK, DM, DZ, EC, EE, ES, R, GB, GD, GE, GH 
GM, HR, HU, ID. IL, IN, IS, JP, KH, KG, KP KR, KZ, LC 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, KfN, MW, 
MX, MZ, NO, NZ, PH, PL, PT, RO, RU, SD, SE, SG, SI 
SK, SU TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU 
ZA, 2W. 

(84) Designated States (regional): ARIPO paieni (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE CH, CY, DE, DK, KS, H, hR, GB, GR, IE, 
IT, LU, MC, Nl., FT, SE, TR), OAPl patent (BF, BJ, CF, 
CG, CL CM. GA, GN, GQ, GW, ML, MR, NE, SN, TD, 
TO). 

Published: 

— without international search report and to be republished 
upon receipt of that report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



< 



(54) Title: METHODS AND SYSTEMS FOR IMAGE-UUIDED SURGICAL INTERVENTIONS 

(57) Abstract: Featured is a system lo determine the three dimensional position and orientation of an effector (a needle, probe, o 
orther medical insirumeni) relative to a subject using cross-sectional images (e.g. from a CT or MRl scanner). Also provided is a 
Q method for image guided effector placement that requires no immobilization of the patient or fiducial implantation. A localization 
^ module (fiducial object) is integrated or associated with the elTecior allowing fur the localization of the elTector in the image space 
1^ using a single cross-sectional image. 
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METHODS AND SYSTEMS FOR IMAGE-GUIDED SURGICAL INTERVENTIONS 

BACKGROUND OF THE INVENTION 

1 , Field of the Invention 

The present invention relates to methods and systems for image-guided effector 
placement. Methods and systems of the invention of the invention enable minimally 
invasive image-guided inter/entions with a single cross-sectional image and without the 
use of a sterotactic frame or separate fidicuial apparatus. Preferred systems of the 
invention include a localization module, integrated with a medical instrument, that allows 
for localization of the effector in targeted image space using a single cross-sectional 
image. 

2. Background 

Percutaneous procedures, i.e. through the skin procedures, require one to find the 
position of an internal target, e.g. organ, tumor, etc., without direct visualization. Most 
often, this involves registration of an image data set, in which the target is identified, with 
physical space. This procedure, stereotaxy, was reported early by Clarke and Horsley 
(Clarke, Brain (1905) 28:12-29). Most techniques have been based upon the attachmoit 
of a rigid frame to a patient, providing a common coordinate system through which the 
image and physical spaces can be related (Galloway, in Interactive Image-Guided 
Neurosurgery. American Association of Neurologic Surgeons (1993) 9-16). While 
stereotactic procedures were initially advanced using two-dunentional imaging 
modalities, the advent of three dimensional imaging systems including Computed 
Tomography (CT) in the 1970's greatly accelerated development and applications. 
Instead of projecting three-dimensional structures into two-dimensions, this modality 
provides a series of 2D image slices, allowing for true three-dimensional reconstruction. 
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The Brown-Roberts- Wells (BRW) frame consisting of three N shaped motifs 
attached to a patient's skull, represented a major advance in localization (Brown, Invest 
Radiol (1979) 14:300-304), Previous frames were constrained to remain strictly 
5 peipendicnlar to the image plane, providing little flexibility (Galloway, '^Interactive 
Image-Guided Neurosurgery, American Association of Neurologic Surgeons (1993) 9- 
16). However, the BRW frame was more versatile in that the position and orientation of 
the frame was fiilly encoded within each image slice such that the position of a point was 
defined in both the frame space and the image space coordinate systems allowing for 
10 rotations and tilting of the fi^e relative to the image plane (Brown, Invest Radiol (1 979) 
14:300-304). 

A number of systems use a rigid stereotaxic frame wherein the frame is attached 
to the patient. These devices tend to be large and unwieldy contraptions that limit the 

15 effective application time of the frame to less than a day. Consequently, the frame must 
be recalibrated before each use. A system was implemented for image guide intracram'al 
needle placement using biplanar x-ray and a fixed head frame (Lavallee, Computer 
Integrated Surgury: Technology and Clinical Applications^ (1996) p 343-351). In 
another neurosurgical system, a surgical plan using multiple CT image slices, register by 

20 docking their robot with the patient's stereotactic head frame, and then place the needle 
without CT surveillance (Kwoh, IEEE Trans BiomedEng (1988) 35:153-160). In 
another system a stereotactic head frame is used to register the robot and image space, but 
are able to perform needle placement under active CT surveillance to confirm the 
position of their end effector (Glauser, Second Annual International Symposium on 

25 MRCAS (Nov. 1 995)). Similarly, a method wherein the placement and register of a 

needle under biplanar fluoroscopy, was developed in order to access mobile organs (e.g. 
the kidneys) (Bzostek et al. The First Joint Conference of CVRMed and MRCAS, (March 
1997) Grenoble, France). 
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Surgically implanted fiducial markers have been employed to gen^ate reference 
jBrame in the patient and have been affixed to the bones, in particular the cranium, to 
prevent the marker fi-om shifting with tnne. These implant systems have been used for 
image-guided applications in the brain where the cranium is readily accessible for 
surgical implantation of fiducial markers. Surgical pins and screws for permanently 
affixing fiducial implants to a patient bone are reported in U.S. Patents 5,397,329 and 
5,6369,255 such that pegs, pins or screws comprising a scanner opaque object are 
surgically implanted into one or more bones such as the cranium, sternum or vertabrae. 
Fiducial markers that are implanted into the patient's soft tissue are reported in U.S. 
Patents 5,941,890 and 6,056,700. 

While these implanted markers are fixed within the body and are unlikely to 
move, there are several drawbacks to their use. Implantation requires surgery wherein 
the markers are inserted or driven into the bones raising the concern of cracking or 
otherwise damaging the support bone in the implantation process. Further surgical 
procedures increase patient discomfort, hospital stays or recovery time and the risk of 
complications such as infection or bone damage. 

It thus would be desirable have improved methods and systems to determine the 
location of an end effector delivery system and the location of an effector such as a 
needle, probe, etc. within a body. It would be fiirther desirable to have such a position 
and orientation system that could be employed in minimally invasive surgical procedures 
without need for ext^al reference frames, surgically implanted fiducial markers or 
calibration procedures. 
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SUMMARY OF THE INVENTION 

We have now discovered image registration systems for determining the three- 
dimensional position and orientation of a medical instrument (effector) such as a needle, 
probe, etc. relative to a subject using one or more cross sectional images of the subject. 
Significantly, methods and systems of the invention enable effector placement without 
use of patient immobilization or separate fiducial implantation. 

More particularly, we have discovered that by placement of a fiducial object 
separate from a patient but in association with a medical instrument, a single cross- 
sectional image can be taken via an imaging device such as Computed Tomography, 
Magnetic Resonance Imaging or ultrasound, and that single image employed to directly 
manipulate and orient the medical instrument during the course of a surgical procedure. 

That is, the invention includes use of an imaging system that comprises an 
imaging apparatus and a medical instrument with an associated fiducial object that can be 
imaged in the same image (cross-sectional image) as a targeted site of the patient (e.g. a 
tumor, organ, etc.); a medical image (cross-sectional image) is obtained that comprises 
both the fiducial object and the targeted site of the patient; and manipulating the 
instrument with respect to the patient using information derived firom the image. 

It should be appreciated that the systems and methods of the invention enable 
direct manipulation of a medical instrument based on a cross-sectional image. 

Thus, the systems and methods of the invention enable calculating, relating and 
manipulation of the position of the medical instrument and target site of a patient (e.g. 
tumor, site for drug delivery, etc.) via the information contained in a single cross- 
sectional image. Prior approaches have required use of multiple reference fi^mes to 
calculate relative positions of a medical instrument and a targeted site of a patient, e.g. an 
image is taken of a target site and a separate fiducial implant and that reference fi^e 



wo 02/22015 



PCT/US01A29073 



-5- 

related to the sq>arate reference frame in which the medical instrument is positioned, 
which relation requires use of a third reference frame or overlay of the first and second 
reference frames. Qearly, the methods and systems of the invention are a significant 
advance which can effectively utilize a single reference frame to calculate, relate and 
5 manipulate relative positions of the medical instrument and target site of a patient. 

Image registration systems of the invention system preferably comprise an 
imaging device, e.g. a scanning device such as a computed topography (CT) or magnetic 
resonance imaging (MRI) scanner or an imaging ultrasomd device. The imaging device 

10 is in communication with a surgical instrument, e.g. an effector such as a needle, probe, 
drug delivery device, and the like. The medical instrument has an associated fiducial 
object (e.g. localization module) that enables generating three identifiable points via a 
cross-sectional image to coordinate pose of the instrument with respect to a targeted site 
of the patient. The fiducial object may be e.g. integral to the instrument, or attached or 

15 otherwise affixed to the instrument. The fiducial object also may be separate from the 
instrument but nevertheless associated therewith provided the fiducial object and the 
instrument maintain a fixed spatial relationship. 

The imaging device typically is in communication with one or more surgical 
20 instruments and can provide substantially contemporaneous communication of data 
provided by the imagmg and corresponding manipulation of the instrument(s). That is, 
the apparatus and methods of the invention provide an active registration system whereby 
a subject is being imaged, e.g. positioned within a CT or MRI scanner, peraiitting direct 
and substantially contemporaneous visualization and confirmation of the location of 
25 effector, and anatomical structures during effector placement. 

The imaging device yields a cross-sectional image that provides three identifiable 
points on the insector plane between the targeted site (e.g. lesion, tumor, site of drug 
delivery) and the surgical instrument. Those three identified points, obtained via a single 
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cross-sectional image, can enable high precision manipulation of the instrument That is, 
image registration systems of the invention can allow for a precise localization of the 
effector in the image space relative to the subject using a single cross-sectional image. 

5 Multiple cross-sectional images also can be employed, particularly to enhance 

accuracy (e,g. by averaging multiple images) and to compensate for patient motion 
during the course of a surgical procedure. The multiple images are typically obtained 
over a period of time, e.g. at least about one or two minutes, or over the course of about 
three, four, five or more minutes. A volumetric image also may be obtained. Multiple 

10 images also may be obtained quite rapidly, e.g. multiple images obtained each second, 
and such rapid imaging extended over the course of a medical procedure. 

Image guidance systems of the invention are advantageously employed in 
percutaneous surgical procedures for localized therapy delivery and diagnostic biopsy, 

1 5 with distinct advantages over prior percutaneous placement techniques. For example, 
while previous techniques have relied on methods that only register the device space 
once; the active single image guidance system is able to perform a registration for every 
scanned image slice. The effector (medical instrument) and patient are contained within 
the cross sectional imager such that images can be taken at any point for confirmation of 

20 eflFector location. An operator can then directly visualize and confirm when an effector 
such as a needle, probe, etc. has reached the desired target. In addition, image guidance 
can be employed to avoid contacting or otherwise damaging sensitive structures (such as 
vascular tissue). In soft tissues, such as the liver, monitoring progress with additional 
scanned images allows the operator to adjust the target and effector trajectory to 

25 compensate for tissue deformation. This allows for fi-equent positive confimiation of 
position and pose of the effector that is a significant safety advantage. Specific 
applications of percutaneous procedures include but are not linuted to prostate biopsy and 
therapy delivery, access to the spine and liver biopsy. 
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The systems and methods of the invention provide significant additional 
advantages. Systems of the invention can effect controlled, well-planned movements of 
the effector with high localization accuracy and error attenuation over a large range of 
positions and orientations such that the risk of inadvertent motion is minimized. In 
5 addition, when using imaging modalities that involve ionizing radiation (such as CT), 
robotic positioning of the effector can reduce or eliminate operator (e.g. physician, 
technician, etc.) exposure to harmful emissions. This system is markedly less invasive 
than previous techniques whereby surgical morbidity, patient discomfort and duration of 
recovery time/hospitalization are reduced. 

10 

Systems and methods of the invention can be employed for a wide variety of 
therapeutic regimes. For example, a variety of materials deposited or administered to the 
patient by the systems and methods of the invention, such as therapeutic agents e.g. 
chemotherapeutics, DNA therapeutics (gene therapy), radiation seed implant, 
15 antibacterial agent, and the like; ethanol; a sclerotic solution; energy such as e.g. high 
intensity ultrasound, directed beam therapy, localized X-ray therapy, photodynamic 
therapy, laser ablation therapy, RF ablation therapy, and the like; energy removal from a 
patient such as cryotherapy; tissue removal such as removal of a tumor, biopsy sample, 
etc. 

20 

Other aspects of the invention are discussed infra. 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 shows schematically a preferred image registration system and operation 
25 cycle thereof of the invention. Data is made available to both the user and a therapy 
planning system to provide a treatment plan. Therqpy is executed via a robotically 
controlled end eJBector. 
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FIG. 2 (which includes FIGS. 2A and 2B) shows a preferred localization device 
attached to the end effector (medical instnunent) for use in the systems and methods of 
the invention. When inserted into the image field of view, a cross section of each of the 
fidicual bars (nine) can q)pear in the scanning image (e.g. CT or MRI), allowing for 
5 registration. 

FIG. 3 (which includes FIGS. 3A and 3B) shows dimensioning and coordinate 
system conventions for fiducial motifs (FIG. 3 A), and one fiducial motif intersected by 
the image plan, where pi, p2, and p3 are the three fiducial bar points of intersection with 
10 the image plan, and/ ^ and ^define the orientation of the image plan relative to the 
fiducial motif (/■= fraction of distance along the diagonal fiducial where intersection 
occurs) (FIG 3B). 

DETAILED DESCRIPTION OF THE INVENTION 

15 As discussed above, a registration system is provided for determining the three- 

dunensional position and orientation of an effector such as a needle, probe, etc. relative to 
a subject using one or more cross sectional images of the subject. The image registration 
system suitably comprises a scanning device such as a CT, MRI or the like, a fiducial 
object (i.e. that can be detected by the unaging ^paratus) associated with a surgical 

20 instrument. Systems and methods of the invention enable effector placement without use 
of patient immobilization or separate fiducial implantation. 

In particular, systems and methods of the invention provide a fiducal object 
representation in a single cross-sectional image that is unique for the pose of the 
25 instrument within the therapeutic field( i.e. the targeted treatment area of the patient) or 
range of motion of the medical instrument with which the fiducial object is associated. 
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By stating that a fiducial object is associated with a medical instrument (e.g. 
probe, needle/needle driver, etc.), it is indicated that the fiducial object is an integral 
component of the medical instrument, attached to the medical instrument (e.g. by 
adhesive, etc.), or where the fiducial object is separately (without physical attachment) 
5 positioned from the medical instrument but the medical instrument and the fiducial object 
maintain a fixed relationship. 

Referring now to the various figures of the drawing wherein like reference 
characters refer to like parts, FIG. 1 schematically illustrates one preferred embodiment 

10 100 of single registration system in accordance with the present invention. Here, a 

patient 20 is located within an imager 30 whereby patient image data 1 10 is collected and 
transferred to a control apparatus 120. A user interface 300 interacts with the control 
apparatus 120 to display localization infonnation and to receive information from the 
user. The therapy planning unit 350 also interacts with the control system 120 and the 

15 user 10 to arrive at a treatment plan. The control apparatus 120 directs a robotic end 
effector 200 that controls a therapy delivery unit 250 located within the imager 30. A 
fiducial object (localization device) 210 is mounted on the end effector 200. The 
progress of the therapy delivery unit 250 in applying the treatment plan can be monitored 
in real-time by imager 30 feedback wherein the position of the therapy delivery unit 250 

20 is determined relative to the target firom a smgle image 114 comprising a cross section of 
the patient 20, the therapy delivery unit 250 and the localization device 210. 

The robotic end effector 200 comprises a mounting site for the fiducial object 
210, a device to hold an effector or therapy delivery unit 250 such as a needle, probe, etc. 
25 and a robotic arm or other device that is capable of translating the held effector in three 
dimensions with a relatively wide range of motion, e.g. at least 3 degrees of motion, more 
preferably at least about 4, 5, 6, 7, 8, 9 or 10 degrees of motion. Preferably, the robotic 
arm has at least 4 or more preferably at least about 5 degrees of motion such that the held 
effector can be located at any specified physical location in any specified orientation. 
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In order to register the therapy delivery unit 250 to the image space, the control 
system 120 has to identify a set of three corresponding points in both the robotic end 
effector 200 (holder) coordinate system, H, and the image coordinate system, /. These 
5 three points define a coordinate system P. By finding the position and orientation of P in 
the image space, and the holder space, , the control system 120 can then 
determine the pose of the robotic end effector (holder) in the image coordinate system, 

ljT^pT{^^y • ^® calibration of the robotic end effector 200 (holder), H, and the 
therapy delivery unit 250 (needle), coordinate systems , were previously 
10 performed whereby the control apparatus 120 can find ^ J, the pose of therapy delivery 
miit 250 (needle) in the image space. 

In order to find the set of three corresponding points in both the image and holder 
coordinate systems using only one cross sectional image, a fiducial object 210 is 
15 employed wherein the device uses the Brown-Roberts-Wells frame (Brown, Invest Radiol 
(1979) 14:300-4). The Brown-Roberts-Wells fi^e is merely illustrative and other 
approaches can be utilized that can uniquely identify three distinct points. 

Now referring to FIG 2, the basic structural element of the fiducial object 210 is a 
20 'N' shaped fiducial motif 214. Preferably, this motif is repeated fliree times, foiming a 
*U' shaped module with one fiducial motif 214 as a base and the other two fiducial motifs 
as sides. The fiducial object 210 is attached to the robotic end effector 200 in such a way 
that the localization device is within the imager field of view. Preferably tfie localization 
device 2 1 0 is rigidly attached to the robotic end effector 200. More preferably the 
25 localization device 210 is attached using at least four screws. The material used for the 
fiducial motifs 214 is opaque to hnager 30 radiation and they are supported by or 
embedded in a material that is transparent to imager 30 radiation. When the imager is a 
CT scanner, a metal rod is used for tiie fiducial motifs, preferably the metal rod is 
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aluminum. More preferably the metal rod is aluminum with a diameter of firom about 0.1 
to about 0.5 inches, preferably a diameter of about 025 inches. The dimensioning 
(Li JL2) and coordinate system (x,y) for the fiducial motif 2 14 is illustrated in FIG. 3A. 
Preferably, Li is about 8 inches and L2 is about 4 inches. However, other values of Li 
5 and L2 will be ^propriate for localization devices employed in different applications. 

A schematic illustration of one fiducial motif 214 intersected by an image plane 
1 15 is presented in FIG. 3B wherein pi, p2, p3 are the three fiducial bar points of 
intersection with the image plane 115. The orientation of the image plane 1 1 5 relative to 
10 the fiducial motif 214 is described by three parameters by/ the fraction of the distance 
along the diagonal fiducial where the intersection occurs; jJ, the angle between the 
fiducial motif plane 214 and the image plane 1 14; and 9^ the angle between the parallel 
fiducial bars and the line of intersection. 

15 The control apparatus 120 can process scanned images to relate the location and 

pose of the end effector and effector into the image coordinate system whereby a CT 
image of each fiducial motif produces a cross section of the three bars, yielding three 
ellipses in the image. By finding the centroids of these ellipses we can locate the centers 
ofthe three bars where they intersect the image plane 'Pl, and 'P3. Using these 

20 three points, the control apparatus 120 can detemiine the position of one corresponding 
point, cpn , in both the holder space, "cpn, and the image space ^cpn . The control 
apparatus repeats this process for the remaining two fiducial motifs to generate all three 
corresponding points. 

25 The distances \FMp^^FMp2 \^nd\FM pj^FM expressed as a fimction of 

andO^ are: 
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|FM„.FiJ/,,| = csc(Wl-/) 



(1) 



|FM^3_FM^2| = csc(^)l2(/) 



(2) 



The ratio of these distance expressed in equations (1) and (2) is: 



FM„^FM 



FM,FM 




(3) 



The ratio (3) is only a fbnction of /, the fiaction of the distance along the 
diagonal fiducial where the intersection occurs. Because the transformation form the 
fiducial motif coordinate system to the hnage space is a rigid body transformation, the 
control apparatus 120 can determine the point where the image plane intersects the 
diagonal bar FM , by finding the ratio of the distances between points 'P\, 'Pi, and 
' Pz, From a previous calibration of the robotic end effector 200 (holder), the control 
apparatus 120 knows the transformation for this point, FM , to the holder coordinate 

system, . Therefore, control apparatus 120 knows the position of this intersection in 
both the image space 'pi, and the holder space * pi, providing one of the three 
corresponding points, cp\ . The control apparatus 120 repeats this process for the two 
remaining fiducial motifs, generating all three corresponding points, cp\ , cpi and cp3 . 

With the set of three point generated by the intersection of each of the three 
fiducial motifs and the image plane, the control apparatus 120 can do more than 
determine one corresponding point in the image holder coordinate systems. For example 
the control apparatus can fiirther determine the angle d (Figure 3b), but there is very little 
accuracy in determining this angle. When operating about 9 = 90^ the sensitivity of our 
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assessment of S{de^^^^^^ld9^j) is zero. In contrast, determination of the 
corresponding point has niucb more attractive properties. 

To robustly determine the corresponding points, the locahzation method must 
have two properties. First, the assessment of ^cpu should be relatively insensitive to 
small measurement errors in I'/?!-'/??] and |';?3-'/?2| . These sensitivities to measurement 
error are: 



. = -/Lf:^Tsin(0) , (4) 



^ _=(l-/)Jl+ 



sin(^) (5) 



Near the operating point {9 =90° and ^.5), the magnitudes of he sensitivities 
are 0.71. As 6 decreases, the system becomes less sensitive to measurement errors. The 
worst case measurement error sensitivity is 1.41. However these sensitivity values 
improve by decreasmg the L\IL2 ratio. 

The second property requires the measured parameters, |'/;i-'p2| and ['ps-^zj be 
s^sitive to small changes in c, the distance from the image plane intersection with the 
diagonal fiducial to the fiducial motif origm (i.e. c = /VA'+4)(Figure3b). This 
s^isitivity is: 



fcy = -csc(0)/jl + |^l (6) 
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At the operating point of 6 =90°, the magnitudes of the sensitivities are 0.71, 
which is the worst case for the system. As 9 decreases, the sensitivity increases. Also, 
as discussed above, the system sensitivity improves by decreasing the LxlLi ratio. 

5 

Applications of the localization methods of the invention are numerous. One 
preferred application is for percutaneous tissue biopsy within the abdominal cavity. 
Briefly, a patient is placed m the CT scaimer and a complete set of unages in the area of 
interest is collected. Next, while the patient remains in the scanner, the physician selects 

10 a biopsy target (e.g. a tumor) and a skin entry site from the image set. A robot, with 
biopsy needle and effector and fiducial object, is positioned such that the fiducial object 
is within the imager field of view. Next, a single image is taken, containing both the 
biopsy target and a cross section of the fiducial object. From this one image, the 
necessary translation and rotation to readi the target is determined and subsequently 

15 executed by the robot. The robot, or an attendant surgeon, can then drive the biopsy 
needle. Because the patient remains within the scanner, a single image will confirm that 
the needle has reached the target site. The biopsy is then taken, completing the procedure 
quickly and with minimal invasiveness. 

20 The above discussion use includes use of a CT scanning system. However, it is 

understood that a variety of other tfaree-dim^ional scanning cross sectional 
methodologies can be employed, including use of an MRI or a scanning ultrasound. 

As also discussed above, the systems and methods of the invention are suitably 
25 employed for a variety of therapeutic applications such as administration of therapeutics, 
administration of energy sources to a patient; energy removal fi?om a patient; tissue 
removal from a patient; and the like. Potential disorders and diseases that can be treated 
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with systems and methods of the invention inchide treatment of cancers (e.g. by 
administration of a chemotherapeutic, administration of radiation or other energy source 
to a tumor, surgical removal of a tumor, etc); removal of a blockage e.g. in coronary 
surgery; etc.; directed or localized therapeutic administration such as for gene therapy; 
5 and the like. 

All documents mentioned herem are incorporated herein in their entirety. The 
following non-limiting example is illustrative of the invention. 

10 EXAMPLE 1 

To determine the accuracy of the single image localization system a localization 
system was examined wherein the effector was a needle. The single slice determination 
of the needle pose, IfT^ , was compared to the multislice ground truth determination of 
needle pose, ^Tj^^ . An average of 13 images were obtained with the robotic end effector 

15 (holder) in each of 5 diiferent poses. All images were obtained in a GE Genesis CT 

Scanner wherein image slices were 5 mm thick and the fanage pixels were 0.7 mm by 0.7 
man. Error is defined as the difference between the multislice determined ground truth 
and the single slice determined pose. Components include angluar error of robotic end 
effector 200 (holder) pose and offset error of robotic end effector Oiolder). From these 

20 two components, net displacement error at the needle tip, 10 cm fix)m the center of the 
robotic end effector (holder) was found. The average angular enror was 0.32^ the 
average displacement offset error was 380 microns, and the average displacement error at 
the needle tip was 470 microns. The displacement error probability density function was 
determined with a best-fit gamma distribution (A= 2.95 and a= 0.16). The maximum 

25 error seen in the 63 images was 1 .45 mm with 95 % of the needle tip displacement errors 
were below 1 .0 mm. 
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Although a preferred embodiment of the mvention has been desCTibed using 
specific temis, such description is for illustrative purposes only, and it is to be imderstood 
that changes and variations may be made without departing fiom the spirit or scope of the 
following claims. 
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What is claimed is: 

1 . An imaging system for invasive therapy of a patient, the system 
comprising: 

an imaging apparatus that can provide a cross-sectional image of a patient; 
a medical instrument comprising a fiducial object that can be imaged in flie same 
image as a targeted site of the patient. 

2. The system of claim 1 wherein the fiducial object representation in the 
image is unique for the pose of the instrument within the therapeutic field or range of 
motion of the instrament. 

3. The system of claim 1 or 2 wherein the image can produce three 
identifiable points to coordinate pose of the instrument and the targeted site of the patient. 

4. The system of any one of claims 1 through 3 wherein the instrument pose 
is directly manipulated in reference to the medical image. 

5. The system of any one of claims I through 4 wherein the relative position 
and ori^tation of the medical instrument and target site of the patient can be determined 
firom the infomiation contained in a single cross-sectional image produced by the imaging 
apparatus. 

6. The system of any one of claims 1 through 5 wherein the system 
comprises a control apparatus that can register the instrument in a detected hnage space 
and calculate instrument movCTient 

7. The system of any one of claims 1 through 6 wherein the control apparatus 
calculates the instrument pose in the image space by generating at least three 
corresponding points. 
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8. The system of any one of clanns 1 through 7 wherein the fiducial object 
comprises three N-shaped fiducial motifs^ and the three N-shaped fiducial motifs are non- 



9. The system of claim 8 wherein the three N-shaped fiducial motifs are 
arranged orthogonally in a U- sh^e with one fiducial motif forming the bottom and two 
fiducial motifs fonning the sides. 

1 0. The system of any one of claims 1 through 9 wherein the medical 
instrument is manipulated manually. 

1 1 . The system of any one of claims 1 through 10 wherein the system fiirther 
comprises a robotic apparatus capable of positioning the apparatus. 

12. The system of claim 1 1 wherein the instrument is positioned by the robot 
in the desired pose relative to the patient. 

1 3. The system of any one of claims 1 through 12 wherein the imaging device 
is a CT, MRI or ultrasound device. 

14. The system of any one of claims 1 through 1 3 wherein the fiducial object 
is affixed to the instrument. 

15. The system of any one of claims 1 through 14 wherein the fiducial object 
is integral to the instrument 



coplanar. 
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16. A method for guiding invasive tberq)y in a patient, comprising: 

a) providing a system that comprises an imaging apparatus and a medical 
instrument comprising a fiducial object that can be imaged in the same image as a 
targeted site of the patient; 

b) obtaining a cross-sectional image that comprises both the fidudal object 
and the targeted site of the patient; and 

c) manipulating the instrument with respect to the patient using information 
derived from the image. 

17. The method of claim 1 6 wherein the relative position and orientation of 
the medical instrument and target site of the patient are determined from the mfonnation 
contained in a single cross-sectional image. 

18. The method of claim 16 or 17 wherein the instrument is manipulated using 
information derived from a single reference frame of the relative position of the 
instrument and target site. 

1 9. The method of any one of claims 16 through 18 wherein the instrument is 
mampulated substantially contemporaneously with respect to obtaining the image. 

20. The method of any one of claims 16 through 19 wherein the instrument is 
manipulated based on a single image. 

21. The method of any one of claims 16 through 20 wherdn a plurality of 
images are obtained. 

22. The method of claim 21 wherein the plurality of images are taken over a 
period of at least one minute. 

23. The method of claim 2 1 or 22 wherein one or more volumetric images are 
obtained. 
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24. The method of any one of claims 16 through 23 wherein a material is 
deposited or administered to the patient by the instrument. 

25. The method of clafan 24 wherein the administered or deposited material is 
a therapeutic agent 

26. The method of any one of claims 1 6 through 25 wherein energy is 
administered to the patient. 

27. The method of any one of claims 16 through 22 wherein energy is 
removed from the patient. 

28. The method of any one of claims 16 through 25 wherein tissue is removed 
from the patient by the instrument. 

29. The method of any one of claims 1 6 through 28 wherein the instrument 
administers to the patient a radiation seed implant, a DNA therapeutic, a 
chemother^eutic agent, a cryotherapeutic treatment, a sclerotic solution, ethanol, high 
intCTsity ultrasound, directed beam therapy, locahzed X-ray therapy, photodynamic 
therapy, laser ablation therapy, or RF ablation ihe^y. 

30. The method of any one of claims 16 through 29 wherein the fiducial 
object representation in the image is unique for the pose of the instrument. 

31. The method of any one of claims 16 through 30 wherein the image can 
produce three identifiable points to coordinate pose of the instrument and the targeted site 
of the patient. 

32. The method of any one of claims 1 6 througib 3 1 wherem the instrument 
pose is directly manipulated in reference to the medical image. 
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33. The method of any one of claims 16 through 32 wherein the instrmnent is 
registered in detected image space by a control apparatus. 

34. The method of claim 33 wherein the instrument is registered in the image 
space by the image generating at least three corresponding points. 

35. The method of any one of claims 1 6 through 34 wherein the fiducial 
object comprises three N-shaped fiducial motifs, and the three fiducial motifs are non- 
coplanar. 

36. The method of claim 35 wherein the three N-shaped fiducial motifs are 
arranged orthogonally in a U-shape with one fiducial motif forming the bottom and two 
fiducial motifs forming the sides. 

37. The method of any one of claims 16 through 36 wherein the medical 
mstrument is manipulated manually. 

38. The method of any one of claims 16 through 36 wherein the instrument is 
manipulated by a robotic apparatus. 

39. The method of any one of claims 16 through 38 wherein the nnaging 
device is a CT, MRI or ultrasound device. 

40. An imaging system for uivasive therapy of a patient, the system 
comprising: 

an imaging apparatus that can provide a cross-sectional image of a patient; 

a medical instrument conq)rising a fiducial object that can be imaged in the same 
cross-sectional image as a targeted site of the patient, the image producing three 
identifiable points to coordinate pbse of the instrument and the targeted site of the patient; 
and 
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a control apparatus that can register the instrument in detected image space and 
calculate instrument movement. 

41 . A method for guiding invasive therapy in a patient, comprising: 

a) providing a system that comprises i) an imaging apparatus, ii) a medical 
instrument comprising an associated fiducial object that can be imaged in the same cross- 
sectional image as a targeted site of the patient, and iii) a control apparatus that can, via 
input firom the imaging apparatus, register the instrument in detected image space and 
calculate instrument movement; 

b) obtaining a cross-sectional image that comprises both the fiducial object 
and the targeted site of the patient, the image producing three identifiable points to 
coordinate pose of the instrument and the targeted site of the patient; and 

c) based on input fi-om the control apparatus, manipulating the instrument 
with respect to the patient using information derived fi-om the image. 

42. A method for guiding invasive therapy in a patient, comprising: 

a) providing a system that comprises i) an imaging apparatus, ii) a medical 
instrument comprising an associated fiducial object that can be imaged in the same cross- 
sectional image as a targeted site of (he patient; 

b) obtaining a cross-sectional image that comprises both the fiducial object 
and the targeted site of the patient, a single image providing infoimation sufficient to 
coordinate pose of the instrument and the targeted site of the patient; and 

c) manipulating the instrument with respect to the patient using information 
derived bom a single cross-sectional image. 
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